Co-design to increase implementation of insomnia guidelines in primary care.

BACKGROUND: Sleep disorders, including insomnia, are widespread problems, which have increased during the COVID-19 pandemic. Guidelines for the treatment of insomnia prioritize non-pharmacological interventions. Nevertheless, primary care professionals lack well-developed material for patient education, that could help implement the treatment guidelines in Flanders, Belgium. OBJECTIVE: This project's purpose is to develop complementary, written educational material, grounded in the principles of evidence-based practice, for primary care. PATIENT INVOLVEMENT: This co-design project involved patients and health professionals. Special attention was given to including patients with low health literacy, and empowering patients when designing in mixed groups. METHODS: Based on the framework of Sanders and Stappers (2014), data were collected and analyzed in four phases. Pre-design, needs were explored using think-aloud studies and focus groups. Next, for generative purposes, the design studio method was used. Then, evaluation of the prototype happened with another series of think-aloud studies. Finally, post-design, implementation of the product was evaluated with a short survey. RESULTS: Twenty-five participants (10 patients and 15 healthcare professionals) contributed to the development of an educational patient leaflet called Sssssst. How do you sleep (at night)? Out of 30 professionals who received the printed leaflet for use in practice, 17 provided feedback after six months. Generally, the leaflet was well received. Visual design aspects stimulated use in practice. DISCUSSION: Written and visual materials aid primary care professionals to educate patients on sleep and insomnia. This supporting tool also stimulates self-management in patients. Although inspiring and educational for all stakeholders, a co-design approach is no guarantee for the product to "fit all".

Recommendations for Researchers on Synchronous, Online, Nominal Group Sessions in Times of COVID-19: Fishbone Analysis.

BACKGROUND: In times of COVID-19, we are challenged to experiment with alternative platforms or software to connect people. In particular, the struggle that arose in health research was how to interact with patients and care professionals. The latter is additionally faced with an extreme workload to fight the pandemic crisis. Creative strategies have been developed to continue research among patients and care professionals to improve quality of care. This paper addresses the issue of synchronous, online, nominal group sessions, a common consensus method used for group brainstorming. OBJECTIVE: The purpose of this study was to share our experiences with performing online, nominal group sessions using the video conference software Microsoft Teams. In addition, we aimed to create a practical guide with recommendations for researchers. METHODS: We critically analyzed the procedures for the online nominal group technique, according to the Fishbone methodology. RESULTS: Performing synchronous, online, nominal group sessions is challenging but offers opportunities. Although interaction with and among the attendees complicates the process, the major advantage of online sessions is their accessibility and comfort because of reduced barriers to participation (eg, lower time investment). The role of the moderators is of major importance, and good preparation beforehand is required. Recommendations for future online, nominal research were formulated. CONCLUSIONS: Online, nominal group sessions seem to be a promising alternative for the real-life commonly used technique. Especially during the COVID-19 pandemic, the benefits must be highlighted. More expertise is needed to further refine the practical guide for using digital software in research and to achieve optimal performance.

The impact of COVID-19 on the well-being, education and clinical practice of general practice trainees and trainers: a national cross-sectional study.

BACKGROUND: COVID-19 has changed General Practice (GP) education as well as GP clinical activities. These changes have had an impact on the well-being of medical trainees and the role of GP plays in the society. We have therefore aimed to investigate the impact that COVID-19 has had on GP trainees and trainers in four domains: education, workload, practice organization and the role of GP in society. DESIGN: a cross-sectional study design was used. METHODS: The Interuniversity Centre for the Education of General Practitioners sent an online survey with close-ended and open-ended questions to all GP trainees and trainers in Flanders, active in the period March - September 2020. Descriptive statistics were performed to analyze the quantitative data and thematic analysis for the qualitative data. RESULTS: 216 (response 25%) GP trainees and 311 (response 26%) trainers participated. GP trainees (63%, N = 136) and trainers (76%, N = 236) reported new learning opportunities since the COVID-19 pandemic. The introduction of telehealth consulting and changing guidelines required new communication and organizational skills. Most of the GP trainees (75%, n = 162) and trainers (71%, n = 221) experienced more stress at work and an overload of administrative work. The unfamiliarity with a new infectious disease and the fact that COVID-19 care compromised general GP clinical activities, created insecurity among GP trainers and trainees. Moreover, GP trainees felt that general GP activities were insufficiently covered during the COVID-19 pandemic for their training in GP. GP trainers and trainees experienced mutual support, and secondary support came from other direct colleagues. Measures such as reducing the writing of medical certificates and financial support for administrative and (para) medical support can help to reprioritize the core of GP care. COVID-19 has enhanced the use of digital learning over peer-to-peer learning and lectures. However, GP trainees and trainers preferred blended learning educational activities. CONCLUSIONS: COVID-19 has created learning opportunities such as telehealth consulting and a flexible organization structure. To ensure quality GP education during the pandemic and beyond, regular GP care should remain the core activity of GP trainees and trainers and a balance between all different learning methods should be found.

Remote versus on-site proctored exam: comparing student results in a cross-sectional study.

BACKGROUND: The COVID-19 pandemic has profoundly affected assessment practices in medical education necessitating distancing from the traditional classroom. However, safeguarding academic integrity is of particular importance for high-stakes medical exams. We utilised remote proctoring to administer safely and reliably a proficiency-test for admission to the Advanced Master of General Practice (AMGP). We compared exam results of the remote proctored exam group to those of the on-site proctored exam group. METHODS: A cross-sectional design was adopted with candidates applying for admission to the AMGP. We developed and applied a proctoring software operating on three levels to register suspicious events: recording actions, analysing behaviour, and live supervision. We performed a Mann-Whitney U test to compare exam results from the remote proctored to the on-site proctored group. To get more insight into candidates' perceptions about proctoring, a post-test questionnaire was administered. An exploratory factor analysis was performed to explore quantitative data, while qualitative data were thematically analysed. RESULTS: In total, 472 (79%) candidates took the proficiency-test using the proctoring software, while 121 (20%) were on-site with live supervision. The results indicated that the proctoring type does not influence exam results. Out of 472 candidates, 304 filled in the post-test questionnaire. Two factors were extracted from the analysis and identified as candidates' appreciation of proctoring and as emotional distress because of proctoring. Four themes were identified in the thematic analysis providing more insight on candidates' emotional well-being. CONCLUSIONS: A comparison of exam results revealed that remote proctoring could be a viable solution for administering high-stakes medical exams. With regards to candidates' educational experience, remote proctoring was met with mixed feelings. Potential privacy issues and increased test anxiety should be taken into consideration when choosing a proctoring protocol. Future research should explore generalizability of these results utilising other proctoring systems in medical education and in other educational settings.

Efficiency, Usability, and Outcomes of Proctored Next-Level Exams for Proficiency Testing in Primary Care Education: Observational Study.

BACKGROUND: The COVID-19 pandemic has affected education and assessment programs and has resulted in complex planning. Therefore, we organized the proficiency test for admission to the Family Medicine program as a proctored exam. To prevent fraud, we developed a web-based supervisor app for tracking and tracing candidates' behaviors. OBJECTIVE: We aimed to assess the efficiency and usability of the proctored exam procedure and to analyze the procedure's impact on exam scores. METHODS: The application operated on the following three levels to register events: the recording of actions, analyses of behavior, and live supervision. Each suspicious event was given a score. To assess efficiency, we logged the technical issues and the interventions. To test usability, we counted the number of suspicious students and behaviors. To analyze the impact that the supervisor app had on students' exam outcomes, we compared the scores of the proctored group and those of the on-campus group. Candidates were free to register for off-campus participation or on-campus participation. RESULTS: Of the 593 candidates who subscribed to the exam, 472 (79.6%) used the supervisor app and 121 (20.4%) were on campus. The test results of both groups were comparable. We registered 15 technical issues that occurred off campus. Further, 2 candidates experienced a negative impact on their exams due to technical issues. The application detected 22 candidates with a suspicion rating of >1. Suspicion ratings mainly increased due to background noise. All events occurred without fraudulent intent. CONCLUSIONS: This pilot observational study demonstrated that a supervisor app that records and registers behavior was able to detect suspicious events without having an impact on exams. Background noise was the most critical event. There was no fraud detected. A supervisor app that registers and records behavior to prevent fraud during exams was efficient and did not affect exam outcomes. In future research, a controlled study design should be used to compare the cost-benefit balance between the complex interventions of the supervisor app and candidates' awareness of being monitored via a safe browser plug-in for exams.